Express Mail Label No. EU639646905US 



PATENT APPLICATION 
Attorney Docket No. D/A2508 



EMBEDDING INFORMATION IN IMAGES USING 
TWO-LAYER CONJUGATE SCREENING 

5 BACKGROUND 



The introduction of the plain paper copier has resulted in a proliferation of paper 
copies of paper originals. A similar result is happening to electronic images, given the 
easy availability of digital scanners and a quick and widespread access to images 

10 throughout the Intemet. It is now very difficult for the creator of an image to generate 
an electronic original, for which he can be assured that illegal copies will not be spread 
to third parties. The use of a digital watermark is a technology that aims to prevent that 
spread, by incorporating an identifying mark within the image that allows one to identify 
the source of the image in an electronic copy. It is important that the identifying mark 

15 not be disturbing or distracting to the original content of the image, while at the same 
time, allowing an easy identification of the source. The watermarks could be added 
either by the scanner or by the halftoning software. 



Watermark identification may be accomplished by embedding a digital 
20 watermark in a digital or printed page that will identify the owner of rights to the image. 
In the past, these images have been produced and delivered in hard copy. In the 
future, these images will be distributed mainly in digital form. Therefore, image 
identification will have to work for both hard copy and digital image forms. 



25 Watermarking can take two basic fomns, visible or perceptible and invisible or 

imperceptible. Visible watermarks are marks such as copyright logos or symbols or 
logos that are imprinted into the digital or printed image to be distributed. The presence 
of the watermark is made clearly visible in the image in a way that makes it difficult to 
remove without damaging the image. The presence of the visible watermark does not 

30 harm the usefulness of the image, but it prevents the image from being used without 
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permission. However, visible watermarks may interfere witli the use of the image or 
with the image aesthetics. The visible watermark is also a potential target for fraud, in 
that it is possible for a fraudulent copier of the image to identify the location of the 
watermark and attempt to reproduce the image without the watermark. 

5 

Invisible watermarks are marks such as copyright symbols, logos, serial 
numbers, etc. that are embedded into digital or printed images in a way which is not 
easily discernible to the unaided eye. At a later time, the information embedded in 
these watermarks can be derived from the images to aid identification of the source of 
10 the image, including the owner and the individual to whom the image is sold. Such 
watermarks are useful for establishing ownership when ownership of an image is in 
dispute. They will be less likely to be useful as a deterrent to the theft of the image. 

While either or both visible or invisible watermarks are desirable in an image, 
15 they represent different techniques for either preventing copying or detecting copying. 
It Is anticipated that document producers may wish to use both kinds of protection. 

The concept of conjugate screen has been used in stochastic screening for 
embedding information into the images. In comparing to the other data-hiding 

20 techniques such as digital watermarks, it has the advantage that it is robust to printing. 
In addition, the embedded information can be retrieved not only digitally, but also 
optically. However, it also has a few weaknesses. First, the information embedding 
process needs substantial computation and is difficult to be implemented in real time. 
Second, the size of the embedded symbol is constrained by the halftone matrix size. 

25 Third, careful registration is required in optical detection. 



2 



Express Mail Label No. EU639646905US 



PATENT APPLICATION 
Attorney Docket No. D/A2508 



SUMMARY 

A new information embedding technology is disclosed using conjugate screen 
concept. More specifically, two screens are applied in a halftoning process, one for the 
areas that corresponds to the symbol to be embedded (object), and one for the 

5 background. Both screens can be conceptually decomposed into a two-layer structure 
similar to supercells. The top layer determines the overall halftone texture, while the 
bottom layer, which is conjugate for background and object, carries embedded data. 
The information can be retrieved digitally or optically. In embedding, symbol sizes are 
no more restricted by the halftone matrix sizes. The computation is relatively simple 

10 and can be implemented in real time. In retrieval, it is relatively robust to registration 
errors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG- 1 represents a system in which the present invention may find particular use; 
FIG. 2 is an illustration of a halftoning arrangement to produce a halftone image; 
15 FIG. 3 is an illustration of a 3x3 halftone screen; 
FIG. 4 is an illustration of a 6x6 input image; 

FIG. 5 is an illustration of the threshold values after the halftone screen of FIG. 3 is 
repeated; 

FIG. 6 is an illustration of the resulting halftone image of from FIGS 4 and 5; 
20 FIG. 7a is an illustration of a 2x2 bottom background screen; 

FIG. 7b is an illustration of a 2x2 bottom object screen; 

FIG. 8 is an illustration of a 6x6 background screen; 

FIG. 9 is an illustration of a 6x6 object screen; 

FIG. 10 shows an exemplar image which embeds a Xerox logo; and 
25 FIG. 11 shows an image which simulates the detection result. 

The present invention will be described in connection with a preferred 
embodiment, however, it will be understood that there is no intent to limit the invention 
to the embodiment described. On the contrary, the intent is to cover all alternatives, 
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modifications, and equivalents as nnay be included within the spirit and scope of the 
invention as defined by the appended claims. 

DESCRIPTION OF THE DRAWINGS 

For a general understanding reference is made to the drawings wherein like 
5 reference numerals have been used throughout to designate identical elements. Each 
location in an image may be called a "pixel." In an array defining an image in which 
each item of data or image signal provides a value, each value indicating the color of a 
location may be called a "pixel value". Each pixel value is a bit in a "binary form" of an 
image, a gray scale value in a "gray scale form" of an image, or a set of color space 
10 coordinates in a "color coordinate form" of an image, the binary form, gray scale form, 
and color coordinate form each being a two-dimensional array defining the image. 

With reference now to FIG. 1 there is shown a general system representing an 
electronic representation of an original document obtained from an image input terminal 

15 10 in a format related to the characteristics of the device and commonly with pixels 
defined at n bits per pixel. The electronic image signals will be directed through an 
image processing unit (IPU) 20 to be processed so that an image suitable for 
reproduction on image output terminal 30 is obtained. Image processing unit (IPU) 20 
commonly includes a halftone processor 40 which converts m-bit digital image data 

20 signals to n-bit image data signals suitable for driving a particular printer or other device 
where m and n are integer values. Commonly, the images may be represented in a 
page description language format, describing the appearance of the page. In such a 
case, the IPU 20 may include a processing element for decomposition of the page, and 
color conversion elements for providing appropriate signals to drive a printer. 

25 

FIG. 2 shows the operational characteristics of halftone processor 40. In this 
example, there is illustrated a color processing system using four separations, C(x,y), 
M(x,y), Y(x,y), and K(x,y), obtained in each process independently for halftoning 
purposes to reduce an m-bit input to an n-bit output. It will be appreciated that the 
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invention is also applicable to a single color separation or black and white reproduction 
situations as well. As depicted in FIG. 2 a source of screen matrix information, screen 
matrix memory 106 provides an input to each comparator 100, 102, 104, 106, and 108 
for each color separation. The other input to each comparator is the m-bit color 
5 separation image data. The output of each comparator is n-bit output which can be 
directed to a printer or similar device for rendering. This illustration is highly simplified in 
that distinct screen matrices may be supplied to each comparator. 

Consider generating halftone images from an input image by a screen threshold 
10 matrix with NxM elements. The matrix is first periodically repeated to cover the whole 
image. The value of each input pixel is then compared to the corresponding threshold 
value. The output halftone value for the image is set to be one if the input value is 
greater than the threshold. OthenA/ise the halftone value is zero. 

15 By way of example only, using FIG. 3 as a 3x3 screen threshold matrix 50, and 

applying the threshold matrix to a 6x6 input image 52 shown in FIG. 4 results in the 
halftone screen shown in FIG. 6. More specifically, FIG. 5 shows the threshold values 
after the matrix of FIG. 3 is periodically repeated. In pixel (1,1) of FIG. 4, the pixel of 
the first row and first column, the input value is 6 and the corresponding threshold value 

20 in FIG- 5 is 2. Since the input value is greater than the threshold value, the output is 1 . 
On the contrary, the input of pixel (1 ,2) in FIG. 4 is smaller than the threshold in FIG. 5 
(4 vs. 6), and the output is 0. FIG. 6 shows the resulting halftone 56 after completing 
the above procedure for each cell. 

25 In accordance with the present invention, information is embedded in halftones. 

Two screens are applied in the halftoning process, one for the areas that correspond to 
the symbol to be embedded (object), and one for the background. In the proposed 
method, both screens can be conceptually decomposed into a two-layer structure 
similar to supercells. Specifically, the top layers, which control the dot allocation among 

30 the small blocks, are the same for both background and object screens. In contrast, the 
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bottom layers that control the dot allocation within each block are conjugate for the 
object and the background. In other words, they have opposite filling orders. The 
bottom layer matrices are typically small (2x2 or 3x3 blocks). 

5 Both the top and the bottom layers can be specified by screen matrices. The top 

layer determines the overall halftone appearances. It can be any halftone screen, 
including stochastic, clustered and dispersed screens. The background and the object 
screens can be generated using the top and bottom screens. This can be illustrated by 
the following example wherein the 3x3 matrix shown in Fig. 3 is used as the top screen. 

10 

FIGS 7a and 7b specifies 2x2 bottom screens for background 58 and object 60, 
respectively. The generated 6x6 background 62 and the object screens 64 are given in 
FIGS 8 and 9 (all the screens only specify the filling order). It can be obsen/ed that the 
corresponding 2x2 blocks of FIGS 7a and 7b contain the same numbers, but at 
15 different locations. For example, the top left blocks of both screens are composed of 2, 
11 , 20, 29, but 2 appears at the bottom left of the block in background and at top right 
in object. Consequently, given the same input, both screens will generate halftones 
with similar overall texture, but with a difference in detail, or with a relative shift. 

20 Generally speaking, for an MxN top screen and LxL bottom screens, the entries 

of the background and object screens can be obtained as: 

bk(i, j) = t (k, r) + (MxN) x [bbk (m, n) - 1], 

ob(i, j) = t (k, r) + (MxN) x [bob (m, n) - 1], 

where 
25 m, n = 0, 1, ...L-1 

k=0, 1, M-1 

r = 0, 1, ...N-1 

i = Lxk + m, 

j = Lxr + n, 
30 where 
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bk(i, j) and ob(i, j) are the (i, j) -th entry of background and object screens, respectively, 
t is the top screen, and bbk and bob are bottom screen for background and object 
screens, respectively. The embedded symbol can be retrieved by digitally or optically 
superimposing a halftone image that is created with either background and object 
5 screen with a uniform input, preferably at mid-tone. FIG. 10 shows an exemplar image, 
which embeds a Xerox logo. FIG. 1 1 simulates the detection result. 

It is, therefore, apparent that there has been provided, in accordance with the 
present invention, a method and apparatus for providing digital watermarks. While this 
10 invention has been described in conjunction with preferred embodiments thereof, it is 
evident that many alternatives, modifications, and variations will be apparent to those 
skilled in the art. Accordingly, it is intended to embrace all such alternatives, 
modifications and variations that fall within the spirit and broad scope of the appended 
claims. 
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